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ABSTRACT 

The House Armed Services Committee asked the GA0 
(General Accounting Office) to examine the HPCC (High Performance 
Computing and Communications) program in terms of: (1) the 
effectiveness of the program's management structure in setting goals 
and measuring progress, and (2) how extensively private industry has 
been involved in the planning and execution of this program. The HPCC 
program aims to accelerate the research and development of high 
performance computers and networks and promote the use of those 
resources in both the federal government and the private sector. The 
administration is now broadening the role of the HPCC program in 
developing new technology in support of the Nil (National Information 
Infrastructure), and industry participation is crucial for the 
creation of new products and services for the Nil. The GAO 
recommended that the HPCC program develop a detailed technical agenda 
as a framework for guiding the government's investment in HPCC 
research. The HPCC budgets are developed without formal g. delines, 
and a more standardized method for spending could broaden industry 
support for the program. Private sector participation could be 
promoted by inviting industry representatives to collaborate on the 
development of program plans. The Assistant to the President for 
Science and Technology (Science Advisor) concurred with the GAO's 
findings and also recommended that a private sector advisory board be 
established. (DGM) 
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United States 

General Accounting Office 

Washington, D.C. 20548 



Accounting and Information 
Management Division 

B-257448 

November 4, 1994 

The Honorable Ronald V. Dellums 
Chairman, Committee on Armed Services 
House of Representatives 

Dear Mr. Chairman: 

This report responds to your request that we evaluate the status of the federal High 
Performance Computing and Communications (hpcc) program. Specifically, you asked that we 
assess (1) the effectiveness of the program's management structure in setting goals and 
measuring progress and (2) how extensively private industry has been involved in the planning 
and execution of the program. The report identifies opportunities to improve the program and 
makes recommendations to the Director of the Office of Science and Technology Policy to 
focus the program more explicitly on its new role in developing new technology in support of 
the national information infrastt cture. 

We are sending copies of the report to appropriate congressional committees, the Director of 
the Office of Science and Technology Policy, the Secretaries of the Departments of Defense and 
Energy, the Administrator of the National Aeronautics and Space Administration, and the 
Directors of the National Science Foundation and the National Coordination Office for High 
Performance Computing and Communications. Copies will also be made available to others 
upon request 

This work was performed under the direction of David O. Nellemann, Director, Information 
Resource Management/National Security and International Affairs, who can be reached at 
(202) 512-2666. Other mayor contributors are listed in appendix If. 

Sincerely yours, 




Gene L. Dodaro 

Assistant Comptroller General 
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Executive Summary 



Purpose 



The federal High Performance Computing and Communications (hpcc) 
program aims to accelerate research and development of high 
performance computers and networks and promote the use of those 
resources in both the federal government and the private sector. A 
successful hpcc program could significantly extend U.S. technological 
leadership and enhance national competitiveness. 



Given the potential impact of the hpcc program on both government and 
industry, the House Armed Services Committee asked gao to examine 
(1) the effectiveness of the program's management structure in setting 
goals and measuring progress and (2) how extensively private industry has 
been involved in the planning and execution of the program. 



Background 



The hpcc program was first included in the President's budget in fiscal 
year 1992 as a coordinated effort among nine federal agencies to 
accelerate the availability and utilization of the next generation of high 
performance computers and networks. The program was also specifically 
authorized by Congress in the High Performance Computing Act of 1991 
(Public Law 102-194). The program, coordinated through the White House 
Office of Science and Technology Policy (ostp), was initially funded at 
$654 million in fiscal year 1992. Funding for fiscal year 1995 is projected to 
grow to more than $1 billion. 



The hpcc program grew out of successful ongoing computer and 
communications research programs at participating agencies, hpcc and its 
predecessor agency programs were instrumental in establishing more than 
a dozen high performance computing research centers throughout the U.S. 
Efforts to provide nationwide access to these centers through 
interconnected high-speed data networks have led to dramatic increases in 
the use of these networks. The computing research centers and networks 
have, in turn, allowed scientists to make significant advances in addressing 
the highly complex, scientific problems that are collectively referred to as 
"grand challenges." Grand challenges include such problems as 
understanding global climate change, analyzing nuclear reactions, and 
mapping the human genetic structure. 



In 1993, the administrati on expanded the scope of the hpcc program to 
include a broader range of applications that will have a more direct, 
near-term impact on the national information infrastructure (Nn), also 
known as the "information superhighway." Although it will be built and 
operated by the private sector, the Nil will involve a wide range of 
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government networking and applications projects in addition to hpcc, 
which will serve as the Nil's research and development laboratory. 
Proponents envision the Nn as a large, interconnected resource of 
computers and communications networks that will enhance information 
access and delivery and that will be essential to the nation's economic 
competitiveness. Within this context, hpcc research is intended to improve 
computerized support for areas that affect all Americans, such as health 
care, education, and manufacturing. 



ReRdltS ill Brief Much valuable research has already been accomplished within the context 

of the hpcc effort Participating agencies have sponsored highly successful 
high performance computing research centers and networks that have 
allowed scientists to make significant progress in addressing complex 
problems in a variety of scientific and engineering disciplines. 

The administration is now broadening the role of the hpcc program in 
developing new technology in support of the nil Industry and academic 
researchers agree that specific technology areas will need to be targeted 
for development to support the Nn. This shift in priorities will require 
changes in planning to accommodate these needs. Given this new context, 
a more focused management approach could help better ensure that the 
program's goals are met A detailed technical agenda will be needed to 
identify priority areas and commit resources to them. Budget information 
is not prepared consistently from agency to agency, which has also 
reduced visibility into how the government is currently investing in hpcc. 

Industry participation, which has always been crucial to hpcc, is even 
more important now that the administration has asserted hpcc's link to the 
planned Nn. Industries that could capitalize on hpcc technologies to create 
new products and services for the Nn could be better represented among 
hpcc program participants. 



Principal Findings 



The hpcc program was originally established, by design, as a loosely 
coordinated, scientifically oriented research effort ralher than a rigorously 
managed development program. Now, however, the administration is 
counting on hpcc to develop the new technology that will be needed to 



New Program Direction 
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make the Nil successful Given that resources for research and 
development are limited, industry and academic researchers agree that 
specific technology areas will need to be targeted for development to 
support the nil 

The hpcc program will have to develop a detailed technical agenda as a 
framework for guiding the government's investment in hpcc research. This 
technical agenda would serve as a master program plan, identifying and 
prioritizing specific technical challenges and establishing a framework of 
expected costs and results, so that program progress could be measured 
and costs controlled. The hpcc program's fiscal year 1995 Implementation 
Han, which provides summary information about planned activities at 
each of the participating agencies, does not yet fulfill this need because it 
does not present a prioritized agenda of research areas linked to the needs 
of the Nn or rationalize its allocation of funds to each of the supported 
research areas. 

hpcc budgets are currently developed by managers at each participating 
agency without any formal guidelines for the program as a whole. As a 
result, the kinds of research activities included in the program and how 
they are categorized vary significantly among participating agencies, 
making it difficult to determine how the government is Apportioning funds 
among competing hpcc research areas. The Implementation Plan is a step 
in the right direction in that it sets a standard format for presenting budget 
information and presents more detailed information than has previously 
been publicly available. Nevertheless, a more standard method for 
characterizing hpcc spending across agencies would afford even greater 
visibility into the overall federal investment and facilitate more informed 
assessments of whether appropriate emphasis is being placed on areas 
that need greatest attention. More open and consistent reporting of 
funding could also broaden industry support for the program by clarifying 
the program's major interest areas and funding priorities. 



Close collaboration with a broad range of industries is essential to 
ensuring that the hpcc program meets its goal of accelerating the 
development and widespread use of hpcc technologies. Although the High 
Performance Computing Act mandated appointing an advisory committee, 
including representatives from industry, concerns about potential 
conflict-of-interest have slowed the effort to establish one. Establishing 
partnerships with industry has become even more important now that the 
admimstration has linked hpcc to the planned Nn. Industries that could 
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capitalize on hpcc technologies to create new products and services for 
the nh could be better represented among hpcc program participants. For 
example, there has been little opportunity for involvement by potential 
developers of new software applications that would make it easier for the 
average person to interact with the nil The program's National 
Coordination Office (nco), which has made some p_ jgress in involving 
iiUustry, could help arrange more opportunities for industry 
representatives to provide substantive input to the program. 

Industry representatives interviewed by gao generally expressed interest 
in participating in the hpcc program but saw the program as not being 
designed to accommodate them. While there has been some industry 
participation, industry was not invited to participate in developing 
program plans. Consequently, several key industry concerns have not been 
adequately addressed, including the need to emphasize applications, 
software development, and standards-setting activities. 



The Director of ostp should take certain actions to focus the hpcc program 
more explicitly on its new role in support of the nh and to involve industry 
more closely in planning and executing the program. For example, gao 
recommends that ostp direct the hpcc program managers to develop an 
explicit hpcc technical agenda that delineates the program's overall goals, 
objectives, and development strategy and that sets priorities and measures 
for specific technology areas, gao also recommends that ostp direct the 
Director of the nco to take additional steps to promote industry 
participation, including involving industry representatives in the program 
planning process, and to provide greater support for standards-setting 
activities. 



In a September 1994 letter, the Assistant to the President for Science and 
Technology (Science Advisor) generally concurred with gao's findings and 
recommendations. His comments are reprinted, along with gao's 
evaluation, in appendix I. Specifically, the science advisor agreed that a 
more focused management approach is appropriate, given the new 
direction of the program, and that a more detailed and prioritized 
technical agenda is called for along with improved consistency in 
preparation of hpcc budgets. He also strongly concurred with the 
recommendation that a private sector advisory committee be established. 



Recommendations 



Agency Comments 
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The science advisor disagreed with what he perceived as gao's view that 
the program be centrally managed and that it have a centrally controlled 
budget gao did not recommend centralizing the program's management or 
budget gao believes that hpcc program goals can be met within the 
framework of the existing program structure. However, achieving and 
sustaining the kind of expanded effort now envisioned for hpcc will 
require identifying specific technical goals and priorities and establishing a 
clear framework for deciding the type of activities to be funded within the 
program. A committee of the National Research Council issued a July 1994 
interim report on the hpcc program that raised concerns in many of the 
same areas that gao addressed, including the need for effective 
performance measures, budget consistency, greater emphasis on software, 
and greater industry involvement 
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The federal High Performance Computing and Communications (hpcc) 
program began in fiscal year 1992 as a joint effort among nine federal 
agencies to significantly accelerate the availability and utilization of the 
next generation of high performance computers and networks. The overall 
goals of the program are to 

♦ extend U.S. technological leadership in high performance computing and 
computer communications; 

♦ provide wide dissemination and application of the technologies to speed 
the pace of innovation and to improve national economic competitiveness, 
national security, education, health care, and the global environment; and 

♦ provide key parts of the foundation for the national information 
infrastructure (nh) and demonstrate selected Nn applications. 

Four agencies— the Advanced Research Projects Agency (arpa), the 
Department of Energy (doe), the National Aeronautics and Space 
Administration (nasa), and the National Science Foundation 
(nsf) — developed the original program plan for hpcc in 1989, and they 
remain the program's dominant participants. In fiscal year 1995 these 
agencies together will spend more than $900 million, or 81 percent of the 
official budget Led by the White House Office of Science and Technology 
Policy (ostp), programs at each of these agencies were drawn together to 
form the governmentwide hpcc program. Ten federal agencies currently 
participate in the hpcc program. 1 

ostp has designated the National Science and Technology Council (nstc) 
to oversee the hpcc program, through its Committee on Information and 
Communications. The nstc, a cabinet-level organization created by the 
President in November 1993, is intended to serve, in part, as a mechanism 
for coordinating research and development strategies across the 
government and for monitoring agency research and development 
spending plans. Since the Nsrc has only recently been established, it is still 
too early to gauge its impact on the hpcc program. Table 1.1 presents an 
overview of reported hpcc spending to date and budgeted amounts for 
fiscal year 1995 by participating agency. 



'In addition to the four original participating agencies, the other six agencies are the National Security 
Agency (NSA), the National Institutes of Health (NTH), the National Oceanic and Atmospheric 
Adrninistration (NOAA), the Environmental Protection Agency (EPA), the National Institute of 
Standards and Technology (NIST), and the Department of Education. NSA joined the HPCC program 
in fiscal year 1994. The Department of Education has been participating since fiscal year 1992, but 
does not have any funding designated for HPCC activities. 
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Table 1.1: HPCC Program Funding by ^^^^^HHH 

Agency and Fiscal Year Dollars in millions 



1992 1993 1 994 1995 
Agency Base* Actual Actual Est Request Total 

ARPA 1 83 232 275 299 357 1 ,346 

NSF 169 201 225 267 329 1,191 

DOE 65 92 101 1 23 .12* 506 

NASA 54 71 82 113 125 445 

NSA 44 • • 42 40 126 

NIH 14 41 47 58 82 242 

NOAA 1 10 10 11 25 57 

EPA 1 5 8 7 14 35 

N1ST 2 2 2 18 56 80 

Total 533 654 750 938 1,153 4,028 



Source: National Coordination Office. 

Note: We did not Ticiejjo rdentiy verify the reported funding amounts. 

a Except for NSA, the HPCC base represents fiscal year 1931 funding for projects that became the 
core of the official program in fiscal year 1992. When NSA officially joined the program in fiscal 
year 1994, it identified $44 million in ongoing fiscal year 1993 activities that were HPCC-related. 
These funds can be considered the base funding for NSA's program. 

The 1989 program plan laid out the original framework and parameters for 
the government's investment in hpcc, proposing that the program grow in 
even increments from a base of approximately $500 million to 
approximately $1,1 billion in its fifth year. In budgeting for the actual 
program, hpcc managers have adhered closely to these original targets. 
Spending is anticipated to continue at over $1 billion annually until 1998. 

To date, the hpcc program and its predecessor agency programs have been 
highly successful. Participating agencies have been instrumental in 
establishing more than a dozen high performance computing research 
centers throughout the U.S. Efforts to provide nationwide access to these 
centers through interconnected high-speed data networks have led to 
dramatic increases in the use of those networks. The computing research 
centers and networks have, in turn, allowed scientists to make significant 
advances in addressing the highly complex, scientific problems that are 
collectively referred to as "grand challenges. " Grand challenges include 
such problems as understanding global climate change, analyzing nuclear 
reactions, and mapping the human genetic structure. 
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In September 1992, ostp established a National Coordination Office (nco) 
to coordinate the activities of the agencies participating in hpcc and to 
serve as liaison to Congress, industry, academia, and the public. The 
office's director serves part-time; this individual is also director of the 
National library of Medicine. The nco provides administrative support, 
disseminates information, and chairs coordination meetings attended by 
officials of the participating agencies. The nco does not assess agency hpcc 
programs or provide guidance to the agencies on their programs. It also 
does not review or have approval authority regarding agency hpcc budgets. 



Agency HPCC 
Programs Vary 
Considerably 



Since hpcc is structured as a consortium of federal research agencies with 
independent programs and budgets, participating agencies can — and 
do — have widely varying approaches to research and development. The 
programs of the four m^jGr participants reveal the diversity of these 
agencies' approaches, arpa and nsf — the mayor participants in terms of 
expenditures — are quite different from nasa and doe. arpa and nsf 
concentrate more heavily on basic research, although all four agencies 
fund scientists working on practical applications of hpcc technologies. 

arpa has been at the forefront of research into critical technologies, such 
as computer time-sharing, computer graphics, computer networks, and 
artificial intelligence, for many years. The agency has had a high 
performance computing program since the early 1980s, arpa funds some 
200 or more hpcc projects, most of which are relatively small-scale efforts 
costing between $100,000 and $500,000. Having no laboratories or centers 
of its own, arpa funds projects that are run half by academic researchers 
and half by industry and other government researchers. It also funds the 
placement of hpcc computers and networks at research sites for use on a 
variety of research problems. 

nsf, like arpa, funds a large number of relatively small-scale research 
projects in a wide range of scientific disciplines, nsf also is similar to arpa 
in providing hpcc computing and communications infrastructure for a 
range of research uses, nsf does this by providing base funding for four 
national supercomputer centers that, in turn, support research in a range 
of disciplines, such as biotechnology, global change studies, and 
manufacturing design. 



nasa and doe, in contrast to arpa and nsf, are involved in hpcc primarily 
because of the potential for hpcc technology to enhance their ability to 
carry out agency missions, nasa's projects, for example, are all linked to 
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either (1) design and simulation of aerospace vehicles or (2) earth and 
space sciences research. Rather than investing heavily in research to 
design new computer architectures and build new systems, nasa 
concentrates on the use and evaluation of hpcc systems in the context of 
its mission needs, doe similarly emphasizes the role of being an early user 
of advanced systems and providing feedback to the systems' developers, 
rather than attempting to develop new system architectures on its own. 
Both nasa and doe have laboratories and centers wit v extensive hpcc 
resources. Much of their hpcc funding goes to projects at these sites. 



Recent Changes in 
Program Direction 



In February 1993, the new administration issued a document outlining its 
strategy for investing in advanced technology. 2 In the document, the 
administration rejected the traditional approach of limiting the federal 
government's technology development spending to support of basic 
science and mission-oriented research in the Department of Defense 
(dod), nasa, and other agencies. The document stated that challenges 
facing the U.S. were too profound to rely on the government's investments 
in defense and space technology to trickle down to the private sector. 
Instead, it called for direct support of private sector technology 
development efforts. 



In keeping with this new thinking; the administration sought to align the 
hpcc program more closely with broader applications that could be 
developed and commercialized in the private sector. Specifically, hpcc was 
linked to the development of a national information infrastructure (Nn). 
ostp envisions the Nn, which is commonly referred to as the "information 
superhighway," as a nationwide infrastructure of high performance 
computing hardware and massive computer databases, all linked together 
by high-speed communications networks and new software that allows 
trained users to access and use the information contained therein. 



The hpcc program's technology support for the Nn is contained in a new 
program component added for fiscal year 1994, called Information 
Infrastructure Technology and Applications (ota). The new component is 
intended to (1) develop the technology base for the nh and (2) work with 
industry in using this technology to develop and demonstrate new 
applications for the nil The ota component is also expected to broaden 
the market for hpcc technologies and accelerate industry development of 
the nil 



2 Prestdent William J. Clinton and Vice President Albert Gore, Jr., Technology for America's Economic 
Growth, A New Direction to Build Economic Strength, February 22, 1993. 
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HPCC's Technical 
Approach 



High Performance 
Computing Systems 



In addition to the new eta component, the hpcc program includes efforts 
undertaken in four other broad areas described below. 



The High Performance Computing Systems component concentrates on 
the development of the underlying technology required to build scalable, 3 
parallel computer systems capable of sustaining trillions of operations per 
second on large problems. Most traditional computers teve one 
computational processor, and traditional compuwr development has 
focused on making this processor faster and more efficient. However, the 
potential for continued increases in speed is reaching the limits imposed 
by the physical properties of the materials used to build the processor. 
Consequently, an entirely new land of computer design is needed if speed 
and performance improvements are to continue. 

Computer scientists see development of parallel processing systems as the 
only way to achieve the dramatic improvements in computer speed that 
will be needed to address large, complex scientific problems. Parallel 
processing means breaking computational problems into many separate 
parts and having a large number of processors tackle those parts 
simultaneously. Greatly increased processing speed is achieved largely 
through the sheer number of processors operating simultaneously, rather 
than through any exceptional power in each processor. Massively parallel 
processing (mpp) refers to large machines that include many cooperating 
processors. Other approaches to parallel processing include clustering 
large numbers of independent workstations together or developing ways 
to link together a number of completely different computer systems to 
address a single complex problem in parallel. 



Advanced Software The primary justification for developing increasingly more powerful 

Technology and Algorithms parallel computer systems is to address the large, complex scientific 

problems, commonly known as the "grand challenges." The grand 
challenges are fundamental problems in science and engineering that 
require significant increases in computational capability to address, such 
as predicting global climate change or testing advanced aircraft designs. 
The Advanced Software Technology and Algorithms component of the 
hpcc program targets software development to make mpp and other high 
performance computer systems useful in addressing grand challenges. 



3 Using the same basic architecture and system software, scalable machines function effectively i; 
configurations that range from a small number of processors to a very large number— hundreds < 
even thousands— of processors. 
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Radically new system software 4 and software tools are needed to operate 
mpp and other parallel systems. Most potential users have not yet adopted 
parallel systems because of the high cost and risk of developing software 
for their specific applications, and because system software for current 
parallel systems is still rather primitive. M^or workshops on hpcc 
software convened in 1992 and 1993 agreed that greater focus on research 
to improve system software and software tools is critical if the hpcc 
program is to succeed. 



National Research and The National Research and Education Network segment of the program 

Education Network focuses on the development of a national high-speed communications 

infrastructure to enhance the ability of U.S. researchers and educators to 
perform collaborative research and education activities, regardless of their 
physical location or available local computational resources. This segment 
has two parts: (1) development of an interagency internetwork and 
(2) gigabit research and development The interagency internetwork 
program will upgrade the networks of participating agencies to higher 
speeds than are currently available and ensure their interconnection. The 
gigabit research and development program will develop new high-speed 
communications technologies through basic research and through 
experimentation with testbed networks located at various sites around the 
country. 



Basic Research and Human The Basic Research and Human Resources segment supports long-term 
Resources research by individual investigators in scalable high performance 

computing. It is also intended to increase the pool of trained personnel by 
enhancing education and training in hpcc Finally, this segment provides 
computing and communications resources needed to support these 
research and education activities. 



Applications With the recent addition of the dta component, the hpcc program now 

targets two kinds of applications as ultimate beneficiaries of the 
technology being developed in the program. Program managers refer to 
these two groups of applications as "grand challenges" and "national 
challenges." 



4 System software is the collection of programs and data that make up and relate to the operating 
system (for example, input/output routines, command-line interpreters, and task scheduling and 
memory management routines). 
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Grand challenges, mentioned above, are aimed primarily at the scientific 
research community. National challenges, on the other hand, are defined 
in hpcc program documentation as major societal needs that hpcc 
technology can address, such as the civil infrastructure, digital libraries, 
education and lifelong learning, energy management, the environment, 
health care, manufacturing processes and products, national security, and 
public access to government information. While grand challenges address 
complex scientific questions, national challenges involve making use of 
large stores of data and information to enhance everyday activities. The 
national challenges are an identified subset of the wide range of potential 
applications that may be developed for the Nil. 



Objectives, Scope, 
and Methodology 



In April 1993, the House Committee on Armed Services requested that we 
evaluate the status of the hpcc program. On the basis of subsequent 
discussions with committee staff, our specific objectives were to assess 
(1) the effectiveness of the program's management structure in setting 
goals and measuring progress and (2) how extensively private industry has 
been involved in the planning and execution of the program. 

To meet our objectives, we reviewed official hpcc program documentation 
of the participating agencies and the nco. We also reviewed the 
administration's statements regarding technology policy and the creation 
of the National Information Infrastructure. We discussed these issues with 
government, academic officials, and private industry from a broad range of 
organizations. 

Specifically, with regard to the program's management, we interviewed 
government officials at 

• Office of Science and Technology Policy, Executive Office of the 
President, Washington, D.C., 

• National Economic Council, Executive Office of the President, 
Washington, D.C., 

• Office of Management and Budget, Executive Office of the President, 
Washington, D.C., 

• National Coordination Office for hpcc, National Library of Medicine, 
Bethesda, Maryland, 

• arpa, Computing Systems Technology office, Arlington, Virginia, 

• Department of Energy, Office of Energy Research, Gaithersburg, 
Maryland, 
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• nasa, High Performance Computing and Communications Office, 
Washington, D.C., 

• National Science Foundation, Directorate for Computer and Information 
Science and Engineering, Washington, D.C., 

• National Security Agency, Ft Meade, Maryland, and 

• National Institutes of Health, Bethesda, Maryland. 

We also interviewed officials from government laboratories, including 

• Oak Ridge National Laboratory, Oak Ridge. Tennessee, 

• Cornell Theory Center, Ithaca, New York, 

• National Center for Supercomputer Applications, Urbana-Champaign, 
Illinois, 

• Pittsburgh Supercomputing Center, Pittsburgh, Pennsylvania, and 

• San Diego Supercomputing Center, San Diego, California 

We interviewed members of the academic community from 

• National Research Council, Computer Science and Telecommunications 
Board, Washington, D.C., 

• Syracuse University, Syracuse, New York, 

• California Institute of Technology, Pasadena, California, 

• Rice University, Houston, Texas, 

• University of Washington, Seattle, Washington, 

• Stanford University, Stanford, California, 

• University of California, Berkeley, California, and 

• University of Colorado, Boulder, Colorado. 

Regarding industry's participation in the program, we reviewed reports 
prepared by industry associations and interviewed representatives of these 
associations, including 

• Computing Research Association, Washington, D.C., 

• EDUCOM, Washington, D.C., 

• American Electronics Association, Washington, D.C., 

• Information Technology Association of America, Washington, D.C., and 

• Computer Systems Policy Project, Washington, D.C. 

We also interviewed industry officials representing 

• Electronic Data Systems Corporation, 

• Eastman Kodak Company, 

18 
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• Microelectronics and Computer Technology Corporation, 

• Boeing Computer Services, 

• Visual Numerics, Inc., 

^ Tera Computer Company, 

• Schlumberger Well Services, 

• General Motors Research Corporation, 

• MasPar Computer Corporation, 

• Silicon Graphics, Inc., 

• Sun Microsystems, Inc., 

• Eli Lilly & Company, 

• Intel Corporation, and 

• Cray Research, Inc. 

A detailed audit of the funding of the hpcc program was beyond the scope 
of this review. Accordingly, we did not attempt to determine the 
appropriateness of funding for any specific hpcc projects or the merits of 
proposals that have not been funded. However, we did collect budget 
information from each of the six agencies included in the review in order 
to assess the program's management processes for tracking and reporting 
how funds are spent 

We conducted our review from May 1993 to June 1994, in accordance with 
generally accepted government auditing standards. The Assistant to the 
President for Science and Technology provided written comments on a 
draft of this report These comments are presented, along with our 
evaluation, in appendix I. 
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The hpcc program is a loosely coordinated group of research and 
development activities sponsored by a variety of federal agencies. To date, 
the program's broad technical goals have been driven by scientists' need 
for ever-increasing computer power to address the grand challenges. Now, 
however, the administration is also counting on the hpcc program to help 
develop the new technology that will be needed to make the Nn successful 
and to give the nation a competitive economic edge. 

In order to best ensure that it stays focused on achieving these more 
immediate goals, the hpcc program could use more explicit management 
controls. First, the program will need to set more specific, measurable 
technical goals by developing a prioritized technical agenda. Such a 
document would serve as a master program plan, identifying and 
prioritizing specific technical challenges and establishing a framework for 
managing costs and evaluating results. Second, the program could make 
hpcc budget and expenditure information more consistent and meaningful 
across participating agencies to improve public visibility into program 
funding patterns. 



As discussed in chapter 1, the hpcc program involves 10 federal agencies 
that have a wide variety of missions and approaches to research and 
development A representative from the White House Office of Science 
and Technology (osrp) stated, and researchers we contacted agreed, that 
this diversity of management approaches is a valuable asset in a research 
environment because it allows a variety of technical approaches to be 
explored. In addition, the m^jor participating agencies— arpa, doe, nasa, 
and nsf — had conducted successful research and development programs 
related to hpcc for some years prior to the establishment of the joint 
program. As such, the ostp representative stated that designating a strong 
central manager for the hpcc program would not be appropriate and that it 
would be disruptive to the programs to impose outside control over them. 

Instead of taking a centralized approach, the ostp representative said 
participating agencies should be seen as members of a consortium, each 
pursuing their own objectives but coordinating their efforts. The agency 
program managers are members of a committee called the High 
Performance Computing, Communications, and Information Technology 
(hpccit) committee. This committee, which is chaired by the nco, meets on 
a monthly basis to coordinate hpcc activities. A number of researchers told 
us that, to date, this arrangement has worked reasonably well, hpcc 
managers are generally given high marks by researchers for sharing 
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information and coordinating their activities. Figure 2.1 shows the 
organization of the hpcc program. 




The program originally operated under the assumption that the advances it 
pioneers in high performance computing would eventually work their way 
down to widespread use for everyday activities throughout the private 
sector. Indeed, much computer research funded by arpa and dod in the 
past for military applications has been the foundation for technology 
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widely used today in personal computers and communications networks. 
However, the administration now argues that the challenges facing the 
U.S. are too profound to rely on the government's investments in defense 
and space technology to trickle down to the private sector. The 
administration intends the hpcc program to play a key role in a more 
focused approach to stimulating commercial development and application 
of new technologies. 

Measuring progress within the program remains an informal process. In 
October 1992, ostp established guidelines for the formal ongoing 
evaluation of federal research programs. Although the guidelines require 
that a program such as hpcc submit a plan for continual and thorough 
evaluation of progress and outcomes, no such plan has yet been prepared. 



The Program's 
Technical Agenda 
Could Be Better 
Defined 



Potential nh applications will require specific new technologies that the 
hpcc program has not yet identified and prioritized as technical goals. For 
example, users of the Nil will need to access and manipulate databases of 
information that are much larger than can be handled efficiently by today's 
systems. Although some large database technology research is going on 
within the hpcc program, no determination has yet been made about 
whether it is apriority area that should be emphasized. Outside 
commentators on the hpcc program have proposed a range of specific 
technology areas, such as this, that could be targeted as a way of 
accelerating development of the nh. 

Rather than targeting specific technology areas for accelerated 
development, the hpcc program has pursued research in many different 
aspects of advanced parallel computing. The program has had two broad 
technical goals, which it originally set out to achieve by 1996. One is to 
gain a thousand-fold improvement in useful computing capability and the 
other is to achieve a hundredfold improvement in computer 
communications capability. 1 The program has aimed to address the full 
spectrum of hardware, software, networking, and training issues 
associated with developing this radically new breed of parallel computers. 

Although much faster computers and networks are certainly a basic need, 
particularly to enable scientists to address grand challenge problems, 
these goals are all-encompassing and do not give enough technical focus 
to the program. Because they are so broad, controversy and confusion 



'Computers of this type would be able to cany out a trillion or more operations per second (one or 
more "teraops"), and communications networks would be capable of transmitting data at a rate of a 
billion bits (one "gigabit") per second. 
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have sometimes arisen as to what the "real" goals of the program are. For 
example, university and industry experts have observed that, in its original 
form, the program appeared to be concentrating heavily on developing 
new hardware architectures, with relatively little attention being paid to 
software issues, thus leaving systems difficult to use. More recently, the 
addition of the Nn-oriented ota component has further broadened the 
technology spectrum to be addressed by hpcc. Both participants and 
outside observers have questioned the extent to which the program is 
actually shifting its emphasis toward m technology issues, given that the 
level of funding for uta projects to develop applications in areas such as 
education and health care is minimal compared with funding for hardware 
systems development 

No official prioritization has yet been made. The program's annual report 
to the Congress describes ongoing work in a number of technical areas, 
but does not prioritize among competing technical goals. For example, the 
annual report states that the five broad component areas of the program 
are considered equally important. Within the new hta component, the 
document identifies a range of technologies that will be needed for the Nn, 
but does not prioritize them or offer an overall strategy for developing 
them 

An explicit technical agenda, identifying and prioritizing specific 
technology challenges and establishing a framework of expected costs and 
results, could go a long way toward better defining the program's 
direction. This agenda could also provide the needed management 
framework for focusing on technologies in support of the Nn. Although it 
could take a variety of forms, an official technical agenda would specify a 
target amount of resources to be invested in each priority area and the 
major results that are expected. Subject to periodic review and 
adjustment, this document would clarify the program's goals and 
objectives, focus efforts on critical areas, and serve as a baseline for 
measuring program progress and results. 

One potential model for identifying and prioritizing technology challenges 
is a draft prepared by the Computer Systems Policy Project an affiliation 
of American computer companies that have an interest in the national 
information infrastructure. 2 The document identifies nine technology areas 
that will be critical to the success of the Nn. For each of these nine areas, 
the document lists a number of specific technologies that need to be 



'Computer Systems Policy Project, Perspectives on the National Informat ion InfrastnKture- 
Accelerating the Development of Nil Technologies . draftverelorr : 
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researched and developed and suggests which of these should receive 
priority attention. 



Budgets and expenditures for hpcc activities, both inside and outside the 
program, have not been accounted for in a uniform and easily understood 
way. Accordingly, it is unclear how much money is actually being spent on 
advanced computing and communications and on what projects. 

Spending for the formal hpcc program has closely followed its original 
plan of expanding in even increments from a $500 million base program to 
approximately $1.1 billion in its fifth year. However, the program budget, 
which is often cited publicly as a measure of the federal government's 
investment in hpcc, actually offers little insight into how the federal 
government is investing in total in hpcc research and development This is 
because participating agencies have diverse research programs and 
equally diverse ways of identifying and categorizing their hpcc spending. 
There are no uniform guidelines for determining what projects to include 
within the hpcc program or for categorizing those projects within the five 
msgor components of the program. 



According to the official summary documents for the hpcc program that 
accompany the President's budget request each year, nearly $3 billion has 
already been spent on hpcc, and, beginning in fiscal year 1995, annual 
budgets will top $1 billion. However, these figures do not reflect the total 
federal investment in hpcc Several types of research and infrastructure 
activities are not consistently included or excluded from the program. 

For example, preexisting government supercomputer centers have 
sometimes been included in the hpcc program and sometimes not Four 
supercomputer centers supported by nsf are included, as is the National 
Cancer Institute's center, however, the supercomputer center at the 
National Center for Atmospheric Research, also funded by nsf, is not 
included. Similarly, NASA includes some of its supercomputer facilities but 
not others. In each case, program managers have made their own 
judgments on what to include under hpcc since no programwide guidelines 
were available. 

Advanced computer research that is not directly related to development of 
scalable parallel computers is another area that is neither clearly within 
nor clearly excluded from hpcc. nsf includes research into advanced 
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optical computing, for example, whereas arpa keeps its optical computing 
research separate from hpcc. nsf's hpcc program also supports 
fundamental research in areas such as the theory of computing, software 
engineering, and the theoretical aspects of computer systems, while arpa 
funds this type of research outside the hpcc program. 



hpcc program documentation uses five component categories to describe 
the types of research and development that are funded within the program 
(these five categories are defined in ch^ter 1). Although this 
categorization could be helpful in understanding how hpcc funds are 
spent, its value is diminished by discrepancies in the way agencies 
categorize their official hpcc spending. Currently, no uniform method for 
categorizing projects is used. Relying on the personal judgment of hpcc 
managers and coordinators, participating agencies group similar prcjects 
differently within the five program categories. 

For example, program documentation generally describes High 
Performance Computing Systems as the hardware component of the 
program. However, hardware spending also shows up in the Advanced 
Software Technology and Algorithms and Basic Research and Human 
Resources categories. 

The Basic Research and Human Resources component, in particular, 
overlaps all the other categories, since program managers have to 
determine whether research is "basic* and then categorize their projects 
accordingly. Program managers have listed a full spectrum of research 
activities under this component, from research on architectures and 
systems, to software, algorithms, and applications. Because of these 
inconsistent classifications, it is difficult to determine what areas hpcc is 
really emphasizing— developing hardware platforms, writing systems 
software and tools, developing software applications, or none of these— or 
how much effort is being expended on each. 



Categorization by Program 
Components Has Not Been 
Consistent 



No Explicit Budget Explicit guidelines for preparing hpcc budgets across agencies, which do 

Guidelines Exist not currently exist, would afford greater visibility into the overall federal 

investment and would facilitate more informed assessments of whether 
appropriate emphasis is being placed on areas that need greatest attention 
Such guidelines should include new, more precise budget categories that 
would provide visibility into how much is to be spent on operating 
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supercomputer centers, placement of computer systems, and other 
activities that support researchers but may not be research per se. 

In April 1994, the nco issued a document providing a detailed analysis of 
the types of activities that each hpcc agency funds and how much is being 
spent for them. 3 The new document is a step in the right direction in that it 
sets a standard format for all participating agencies to use in presenting 
budget information and presents more detailed information than has been 
publicly available before. However, the document does not resolve the 
discrepancies in how various agencies account for their hpcc activities. 

In addition to increasing visibility into the government's investment, more 
open and consistent reporting of hpcc funding could also broaden industry 
support for the program, because the program's nuyor interest areas and 
priorities for funding would be clearer. 



Conclusions While continuing to foster basic research to address scientists' need for 

ever-increasing computer power to address grand challenge problems, the 
hpcc program is also taking on the task of developing the specific 
technologies that will be needed for the nil In order to be successful at 
that new task, the program could benefit from a detailed technical agenda, 
identifying and prioritizing the kinds of technologies it will develop in 
support of the nil Such a document would better define the program's 
direction and also serve as a baseline for measuring future progress. 

The budget information annually reported to Congress on hpcc does not 
provide enough visibility into how much the government is investing in 
hpcc or what kinds of research and other activities are being funded. Much 
of the problem is due to the fact that no precise guidelines exist for 
determining what activities to include within the hpcc program. Also, the 
program's five component categories, while useful in describing the 
program generally, are not helpful in revealing the specific kinds of 
activities that are being funded. 



Recommendations We recoitunend the Director of ostp direct the hpcc program 

managers, in consultation with industry and academic representatives, to 
develop an explicit hpcc technical agenda, delineating the program's 
overall strategy and setting development priorities for specific technology 
areas. This document should specify target amounts of resources to be 
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3 FY 1995 Implementation Plan, National Coordination Office for HPCC, April 8, 1994 
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invested in each priority area and the mayor results that are expected, so 
that it can be used as a baseline for measuring progress and controlling 
costs. 

We also recommend that the Director of osrrp develop, in consultation with 
the Office of Management and Budget and the Congress, detailed 
guidelines for preparing hpcc budgets, including guidance on the types of 
activities to include in the program and how they should be categorized. 
ostp may wish to delegate this task to the nstc Committee on Information 
and Communications. 



Agency Comments 
and Our Evaluation 



In his September 1994 comments, the Assistant to the President for 
Science and Technology (Science Advisor) concurred with our findings 
that a more focused management approach is appropriate, given the new 
direction of the hpcc program. He said that this more focused approach 
will include improved consistency in preparation of hpcc budgets within 
participating agencies as well as a more detailed and prioritized technical 
agenda to ensure that the goals of the program are clearly defined and 
success is clearly measurable. 



The Science Advisor disagreed with what he perceived as our view that 
the program be centrally managed and that it have a centrally controlled 
budget However, we did not recommend centralizing the program's 
management or budget; instead, we discussed the advantages of a 
coordinated approach as well as the drawbacks of central management 
We agree that hpcc program goals can be met within the framework of the 
existing program structure. However, achieving and sustaining the kind of 
targeted effort now envisioned for hpcc must begin with the identification 
of specific technical goals and priorities. These specific goals and 
priorities, once established, can then form an objective framework for 
making decisions about the type of activities to be funded within the 
program and the amount of funding to be allocated for each. 

In July 1994, a committee of the National Research Council issued an 
interim report on the hpcc program that raised concerns in many of the 
same areas that we addressed. 4 The committee, whose study is still 
ongoing, said it would continue to examine areas such as the potential for 
developing standard program performance measures for hpcc and the 
need for greater budget consistency. 



4 Interim Report on the Status of the High Performance Computing and Communications Initiative , 
National Research Council, July 1, 1994. 
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Close collaboration with industry is essential to ensure that the hpcc 
program meets its goal of accelerating the development and widespread 
use of hpcc technologies. While industry has been extensively involved in 
the actual execution of hpcc projects, as the program moves forward it 
would benefit from partnerships with key industries that could capitalize 
on hpcc technologies to create new products and services for the Nil. 

Representatives from a variety of companies with a potential interest in 
hpcc told us they remain uninvolved in the program for several important 
reasons. They expressed the belief that the program does not address their 
needs and interests, largely because hpcc managers have not solicited their 
input in program planning. Also, the nco, which was establishe i in part to 
foster industry participation, has not provided industry representatives 
with needed information or responded to industry initiatives to improve 
communications between the program and potential industry participants. 
Given that the administration sees the hpcc program as playing an 
important role in developing key technologies for the nh, hpcc managers 
must more effectively promote industry participation. 



Achieving Nil-Related 
Goals Requires 
Government 
Researchers to 
Collaborate Closely 
With Industry 



Since the program's inception, hpcc program documentation has 
emphasized that industry participation is critical to meeting the program's 
goals of accelerating the development and widespread application of high 
performance computing and networks. Now, industry's collaborative role 
has become even more important in the context of hpcc's new role of 
supporting development of the m. 

Specifically, the hpcc program is now committed to helping the private 
sector develop new technologies, including applications and services, that 
will maximize the value of the no to a broad base of users. Hiese 
applications include remote medical diagnosis by specialists and experts 
anywhere in the nation; the delivery and use of environmental information 
for a broad range of users, such as agriculture workers and truckers; and 
enhanced educational opportunities in which students could perform 
science experiments in collaboration with scientists at the national 
laboratories or visit museums and research centers without leaving their 
classrooms. In each case, it is envisioned that these applications will be 
developed by the private sector, with some level of government support 
One goal of government collaboration will be to help ensure that issues of 
access' / 2y, security, and reliability are addressed. 
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Industry Has Focused 
on Execution Over 
Program Planning 



Industry involvement in the actual execution of the hpcc program has been 
extensive. At arpa alone, for example, 43 percent of the hpcc budget goes 
to companies that have successfully responded to arpa's requests for 
research proposals in specific technological areas, doe also has 
established cooperative agreements with numerous partners from 
industry. Nevertheless, hpcc managers have generally not involved 
industry in planning the hpcc program. At the governmentwide level, a 
mechanism for obtaining nonfederal advice and evaluation was mandated 
by the High Performance Computing Act, which directed the President to 
establish an advisory committee including representatives from industry. 
According to osnp officials, the administration is working to get the 
advisory committee appointed, although concerns about potential 
conflict-of-interest have slowed the effort 



Many hpcc agencies have their own advisory committees that review their 
hpcc programs. These committees have been helpful in planning effective 
agency programs. A case in point is nasa's program, which was reviewed 
in 1993 by a nasa Advisory Council Task Force. The task force reported 
that the priorities in the agency's hpcc plan did not address the research 
problems that the aerospace industry considered most critical, nasa 
responded by soliciting direct industry involvement in reworking its 
program plan for aerospace. Aerospace industry representatives told us 
they are encouraged that a revised plan will more fuLy reflect their 
interests and concerns. 



The nco, which was established in part to serve as a point of entry for 
industry into the program, disseminates general information about the 
program as well as funding opportunities. The nco recently made this 
information available electronically over the Internet In addition, the nco 
has been involved in numerous liaison activities with industry, academia, 
and the public. These activities have included meetings, workshops, and 
conferences. The nco has also allowed groups of industry representatives 
to attend certain designated portions of the hpcc program managers' 
regular meetings and give brief presentations of their views. 

Industry representatives whom we contacted agreed that all of these 
activities are valuable. However, they seek greater opportunities for close 
collaboration between government and industry in planning program 
direction. They have proposed that the nco cooperate in arranging for the 
hpcc program to participate officially in symposia, in order for industry 
and academic representatives to meet with program managers to air their 
views on the direction and priorities of the program. They emphasize that 
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these meetings should provide for a full discussion and consideration of 
issues of importance to industry, such as how best to invest limited 
resources. The nco could exercise this fimction until a permanent advisory 
committee, which will maintain a more substantial, ongoing dialogue with 
program management, is appointed 



A mauor roadblock to broader industry utilization and commercialization 
of high performance computing technologies is the lack of software and 
software development tools to take advantage of the power of high 
performance computers. Currently, only a limited range of applications 
software is available, and development tools, which are needed to write 
new applications software, are primitive. Moreover, a lack of standards 
discourages industry from investing in software development projects that 
may have a limited market A greater emphasis by the hpcc program on 
software could reduce some of the risks for potential industry participants 
and increase their involvement 



Existing Software hpcc so far has focused on the grand challenges as target applications. 

Applications and Tools Are Wttile the grand challenges are important scientific problems, they involve 
Inadequate onl y small communities of scientists working in specialized areas. For 

example, applications developed in NASA's hpcc program are targeted at 
aerospace engineers designing and simulating new aircraft. Earth and 
environmental scientists, likewise, will profit from various hpcc projects 
supported by nasa, nsf, doe, and arpa. As valuable as these lines of effort 
are, they do not directly address broad areas where hpcc technology can 
benefit the Nil, and industry tends to view them as offering little 
opportunity for commercialization. 

One of the most important industry applications of hpcc on the no will be 
information processing and management A core set of generic software 
for processing, storing, searching, and retrieving multiple datatypes from 
very large databases would have a broad range of commercial 
applications, ranging from health care to banking. For example, software 
for handling databases of imagery would enable applications as diverse as 
remote medical consultations or law enforcement 

Software development tools, which would make it easier for software 
companies to design and develop new ^plications, might offer a 
particularly good opportunity to leverage government investment in hpcc 
A series of reports by groups of hpcc researchers has identified and 
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prioritized the tools that would be needed to facilitate the development of 
a broader range of applications software. These include debugging tools, 
memory management tools, and performance analysis tools, all of which 
would help to create a more productive software environment 

The hpcc program already supports some research in these areas. 
However, by establishing software development as a priority and devoting 
more resources to it, hpcc would encourage industry to invest in the 
development of a wide range of specialized Nn applications. 



Standards-Setting 
Activities Need Greater 
Support 



Developers have identified the lack of standards as an impediment to more 
intensive commercial development of hpcc applications software. 
Agreement on standards would permit commercial software developers to 
build programs that work on a variety of high performance computers, 
rather than on only one specific hardware system, which may or may not 
do well in the marketplace. Broadening the base of computers on which 
the software will run would expand its potential commercial market, 
thereby allowing developers to put a much greater effort into building 
applications software. 

However, setting standards is a difficult process, requiring a great deal of 
interaction over time within the hpcc community. Industry representatives 
agree that the government should not set standards. Industry, they believe, 
must lead this effort. Nevertheless, the government can play a practical 
role in supporting standards-setting efforts. 

The hpcc program already provides funding for several standards-setting 
activities. For example, several agencies support a project to establish a 
standard hpcc version of the Fortran programming language. However, 
industry representatives have urged greater government support for 
standards-setting activities in order to stimulate commercial software 
development Specifically, the hpcc program could fund more workshops 
where government, academia, and industry can come together to discuss 
and collaborate on emerging standards. The program could also provide 
more direct support for researchers to work with industry on evaluating 
potential standards. 



Conclusions 



It is widely recognized that the hpcc program needs a standing advisory 
committee that includes representatives from a broad range of potential 
industry participants. Such a committee would provide the mechanism to 
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sustain an ongoing dialogue between the program and industry. However, 
in addition to establishing this committee, program officials can take 
additional steps to promote industry involvement, through cosponsoring 
symposia with industry and involving industry representatives in the 
program planning process, in order to forge a true partnership between 
government and industry. 



Recommendations We recommerM * that ^ e Director of ostp (l) take steps to expedite the 

appointment of an advisory committee whose membership includes 
representatives from a wide range of industries, and (2) delegate to the 
nco the role of sponsoring symposia where industry can meet with 
program officials and academia to help define the research priorities of the 
program. 

We also recommend that ostp direct the Director of the nco to take 
additional steps to promote industry participation, including involving 
industry representatives in the program planning process, and providing 
greater support for software development and standards-setting activities 
to make it easier for industry to develop applications for deployment on 
the nil 



In his formal comments, the President's Science Advisor strongly 
concurred with the recommendation that a private sector advisory 
committee be established and noted that ostp was taking the initial steps 
to do so. The Science Advisor did not comment on our recommendation 
that the nco sponsor symposia involving industry, academia, and hpcc 
program managers. 

In preliminary discussions on a draft of the report, hpcc program managers 
maintained that the program has already implemented our 
recommendation to place greater emphasis on developing software tools 
and sponsoring standards-setting activities, as documented in the fiscal 
year 1995 Implementation Plan. We, however, do not agree that a 
significant shift in emphasis has yet occurred. While the implementation 
plan recognizes that greater focus on software tools will be required to 
encourage industry involvement in developing applications, a small 
percentage of the budget for the advanced software technology and 
applications component is allocated to this area We believe that the 
program could better leverage federal funding by devoting more resources 
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Chapter 3 

Greater Industry Involvement Could Help 
the HPCC Program 



to activities that would make it easier for private industry to develop a 
broader range of applications. 

In its interim report, the National Research Council's hpcc study 
committee expressed concerns similar to ours. The committee 
recommended that an hpcc Advisory Council be appointed immediately to 
provide broad-based, active input to the hpcc program from industry and 
academia as well as government The committee also expressed concerns 
about the need for software development to catch up with advances that 
have been made in hpcc hardware development 
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Comments From the Assistant to the 
President for Science and Technology 



Note: GAO comments g^lHHHHB^HHI^HMBBHI 

supplementing those in the i : 

report text appear at the 
end of this appendix. 

THE WHITE HOUSE 
WASHINGTON 



September 20, 1994 



The Honorable Charks Bowsher 
Comptroller General of the United States 
General Accounting Office 
GAO Building 
441 G Street, NW 
Washington, DC 20548 

Dear Mr. Bowsher: 

On behalf of the member agencies of the Federal High Performance Computing and 
Communications (HPCC) Program and the HPCC National Coordination Office (NCO), I 
would like to express our compliments and gratitude to the General Accounting Office (GAO) 
for your careful review and serious critique of our response to the initial draft report on the 
See comment 1 . HPCC Program. Our response represented a unique interagency consensus which was 

coordinated by the HPCC NCO and formally provided to GAO by the Office of Science and 
Technology Policy (OSTP). We were very pleased to see our substantive comments 
appropriately addressed in the revised Report, either by correcting the record or by 
presentation of our position with GAO's assessment of our viewpoint. The purpose of my 
letter, in addition to complimenting your team's outstanding effort, is to summarize our points 
of agreement with the observations and ^commendations in the final report; to provide an 
update on actions we already have underway which address recommendations in the Report; 
and to cite those few remaining points on which we disagree. 

We concur with the observations that a more focused management approach is 
appropriate given the recent addition of R&D support for the National and Global Information 
Infrastructures (NH/GII). More focused manag>^ment will include improved consistency in 
preparation of HPCC budgets within the respective agencies, and development of a more 
detailed and prioritized technical agenda to ensure that the goals of me Program are clearly 
defined and success is clearly measurable. We also strongly concur with the recommendation 
that a private sector advisory committee be established. The Administration is moving through 
the nomination and approval process at the present time. 

While we concur in these observations and recommendations, we have several caveats 
and I want to update our recent progress and current action being taken to address these issues. 

As you are aware, the HPCC Program was formed several years ago from existing 
agency programs in computing and communications technologies. Despite broad guic. ind 
discussion among the HPCC agencies, their respective budget components which were 
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determined to fall under the HPCC banner varied from agency to agency. Correcting this 
inconsistency must be accomplished, but it is important to recognize the evolutionary nature of 
this process, which takes place over several budget cycles, to prevent radical departures from 
past budgets that Congressional appropriates and senior management in the Departments and 
Agencies have become familiar. To do otherwise can put crucial programs at risk. 

The HPCC agencies should be commended for developing a comprehensive 
Implementation Plan which establishes a reasonably detailed technical agenda for the Program, 
and which shows the various interagency linkages at the project level. We feel the principal 
shortfall of the Plan at this time is inadequate prioritization of the various projects. Although 
we must do a better job of prioritizing goals and activities, simply "rarjk^rdering B the many 
individual efforts is neither practical nor wise. Complex programmatic linkages exist among 
the projects within any one agency as well as with its partner agencies. A delicate balance is 
maintained among the goals and activities of the overall HPCC enterprise to ensure that 
hardware is not developed without appropriate software and applications being produced on a 
commensurate time scale. The complexities inherent in this undertaking make detailed and 
prioritized technical agenda development an ongoing evolutionary process. 

We would also like to note that although the advisory committee has not yet been 
appointed, close interaction and coordination with industry continues to be a high priority at 
the HPCC NCO and in the member agencies. Additionally, private sector input has been 
available via the National Information Infrastructure Advisory Committee. 

Finally, we cite those areas where we still disagree with the revised Report. Although 
we agree with the general recommendations of a more focused management approach, we 
strongly disagree with the suggestion that advocated a centrally managed program, with a 
centrally controlled budget. The HPCC Program has been a role model for the "virtual 
agency H process which the Clinton-Gore Administration has emphasized in its quest for more 
efficient and productive Government. Control of a virtual agency is more a consensus 
building task than a rigid centrally managed structure. The benefit of "coordination" as 
opposed to "direction* is absolutely essential if we are to succeed in leveraging the talents and 
expertise of the member agencies. Agencies and their authorizes and appropriators expect 
that an Agency's legislative mandate and priorities will not be subject to authoritarian 
redirection by interagency groups. These interagency organizations are important m^pc for 
collegia! cooperation and technology transfer, for sharing development assignments and getting 
mere bang for the taxpayer dollar. They are also an important means of aggregating 
requirements and development strategies to increase the effectiveness and utilization of the 
Federal R&D enterprise. But participation is more voluntary than mandated. If an attempt is 
made to set interagency priorities above Agency mandates, it could destroy the process and 
deny the benefits cited above. Great care should be taken not to put this important process at 
risk by pursuing fruitless outdated authoritarian management practices in place. For an R&D 
enterprise as broad and complex as HPCC, some diversity in technical approach is desirable. 
In addition, it is important to recognize that Department and Agency he'^'s are governed by 
respective bodies of law which specify their mission and the manner in which they allocate 
resources. We must respect these statutory boundaries by seeking to effectively leverage the 
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activities in many agencies without usurping the authority and responsibilities of any individual 
agency to allocate its resources to best meet its mission requirements. It is important that we 
not shatter the compact of cooperation and trust among the member agencies on our "virtual 
agency" team. 

The hard work and dedication of the HPCC NCO has served as a "pathfinder* in our 
mutual quest for more efficient and productive Government. We believe chat the outstanding 
successes which you cite in your report have been produced under the NCO's leadership and 
should be credited to the star! of that office and to the dedicated members of the High 
Performance Computing and Communications and Information Technologies (HPCOT) 
Committee. 

We appreciate your response and opportunity to comment again. Please accept our 
commendations for your constructive critique of the HPCC program. 



Sincerety, 



Assisnnfto the President 
for 

Science and Technology 
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The following are gao's comments on the letter from the Assistant to the 
President for Science and Technology dated September 20, 1994. 



GAO Comments L We discussed a of report with the High Performance 

Computing, Communications, and Information Technology (hpccit) 
committee, which is composed of representatives from each of the 
agencies participating in hpcc. The hpccit committee also provided us with 
preliminary written comments. 

2. This issue is discussed in the "Agency Comments and Our Evaluation" 
section of chapter 2. 
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Information 
Management Division, 
Washington, D.C. 



Franklin W. Deffer, Assistant Director 
John A. deFerrari, Assistant Director 
Elizabeth L Johnston, Senior Evaluator 
Shane D. Hartzler, Reports Analyst 
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